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Abstract 

A power optimal scheduling algorithm that guarantees desired throughput and bounded delay to 
each user is developed for fading multi-access multi-band systems. The optimization is over the joint 
space of all rate allocation and coding strategies. The proposed scheduling assigns rates on each band 
based only on the current system state, and subsequently uses optimal multi-user signaling to achieve 
these rates. The scheduling is computationally simple, and hence scalable. Due to uplink-downlink 
duality, all the results extend in straightforward fashion to the broadcast channels. 

Index Terms 

Power minimization, scheduling, stability, convex optimization, super-position encoding and 
successive decoding. 
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I. Introduction 

We consider a multi-access fading channel with N users and a single access point. Each user k 
requires certain long term rate (throughput) guarantee a&. Our aim is to design a scheduling strategy 
that arbitrates, in every slot, the instantaneous rate assignment to each user and coding strategy to 
realize the assigned rates depending on the current fading states so that the throughput requirement 
for each user is fulfilled and the total power expenditure is minimized. 

In their seminal work, Tse and Hanly have characterized so called throughput capacity and delay- 
limited capacity of the multi-access fading channel with Gaussian noise [1], [2]. The throughput 
capacity region quantifies the achievable rate region with average power constraint for ergodic fading. 
For the delay limited capacity, each user must be given the required rate irrespective of its fading 
states in every slot (strict delay of one slot). The aim here is to obtain a coding and power allocation 
scheme to minimize the energy. 

The notion of throughput capacity leads to schemes that take advantage of users' differential channel 
qualities. Specifically, it is known that the sum throughput in the system is maximized by letting only 
one user with the best channel transmit. Schemes that take current channel states into account while 
making scheduling decisions are referred to as "Opportunistic Scheduling" and may result in unfair 
rate allocation if the fading statistics are not symmetric which is typical in wireless systems. To 
alleviate this limitation, several opportunistic scheduling schemes with fairness constraints have been 
designed [3], [4]. Among them, Proportional Fair Scheduling (PFS) has many desirable properties 
including provable fairness guarantees and suitability for on-line implementation, i.e., without prior 
knowledge of channel statistics [5]. But, PFS does not guarantee the required throughput to users. 

Unlike opportunistic scheduling schemes, the delay-limited schemes guarantee the required through- 
put to every user. Specifically, super-position encoding and successive decoding is shown to minimize 
power for achieving the required throughputs [2]. But, the minimization is achieved under an additional 
constraint that the required rate should be provided to each user in each slot irrespective of its channel 
state. Thus, these schemes can not benefit from users' channel variability over time. Recently, we 
have shown that the significant power saving can be achieved by exploiting a small delay tolerance 
of the application [6]. In absence of a specific delay constraint, the proposed scheme is shown to 
minimize power while guaranteeing the desired throughput and bounded delay for each user. The 
optimality result has been shown in asymptotic case, i.e., as the number of users go to infinity [6]. 
Optimality for the finite users case has remained open. 

For finite users case, [7], [8], [9] have found back-pressure based scheduling strategies to minimize 
the energy consumption in the wireless system with ergodic fading while providing the required 
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throughputs and bounded delays to the users. These schemes assume that the coding strategy is 
predefined and for the given coding strategy determine the rate to be provided in each slot by solving 
an optimization problem. The optimization problem may be non-linear depending on coding/signaling 
strategy used, and hence may become computationally expensive in practice. 

Here, we consider the finite users case, and propose a computationally simple power optimal scheme 
that provides the required throughputs and bounded delays to the users. The optimization is over the 
joint space of coding and rate allocations. Specifically, the proposed optimal policy is back-pressure 
based policy like that in [7], [8], [9], and employees super-position encoding and successive decoding 
in each slot. The proposed policy arbitrates scheduling based only on the users' current backlogs and 
the channel states. In spite of using this limited information, it is shown to be optimal even in the 
class of offline policies that take into account the channel states and arrivals in past, present and even 
the future slots. One of the main challenges in execution of the proposed policy is that the optimal 
rate allocation can only be obtained by solving a convex optimization in every slot. But, we obtain 
a computationally simple algorithm that exploits the problem structure and solves the optimization. 
All the results extend in straightforward fashion to the broadcast case because of uplink-downlink 
duality [10]. 

The paper is arranged as follows. In Section [Til we present our system model. In Section Hill we 
present some known results that we use. In Section Jvl we propose our optimal policy and prove its 
optimality. In Section IVl we conclude. 

II. System Model 

We consider a multi-access channel with N users. Time is slotted. For each user k, let {Ak(t)}t>i 
denote the random process of arrivals, i.e., A^t) denote the arrivals for k in slot t. We assume that 
A(t) = [Ai(t) ••• A]y(t)] are the independent and identically distributed (i.i.d.) random vectors 
across the slots. Moreover, let au = ~K[Ak{t)]. Alternatively, au denotes the throughput requirement 
of user k. We assume that < oo for every k. The arrivals for each user k are queued in the infinite 
capacity buffer. We denote by Q(t) = [Qi(t) ■ ■ ■ Q^{f)\, where Qk(t) is the backlog or queue length 
for user k in slot t, i.e., Qk(t) is the difference between the total arrivals minus the total departures 
until time t. 

Now, we describe our channel model. We assume multi-band system. Specifically, we assume that 
there are M non-interfering bands available for communication. Let c4(i) = [dki(t) ••• d^M^)] 
denote the vector of channel gains for user k in slot t on each of the bands. Thus, if E^^ m {t) denotes 
the transmit energy per symbol for user k on sub-band m in slot t, then the received energy on 
the sub-band is given by dk tTn (t)Ek im (t). We assume that {dk(t) : k = 1, ... ,n} t >i is a positive 
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recurrent finite state Markov process. Note that this assumption is not restrictive as correlated Rician 
and Rayleigh fading channels can be modeled reasonably well using a finite state Markov process 
[11], [12]. Let Nq denote the noise power spectral efficiency. 

Let Rk, m (t) denote the service rate for user k on sub-band m in slot t. Then, for every k, the 
queue length dynamics is characterized by 

r M 

Q k (t + 1) = max | Q fc (i) + A k (t) - ^ R k , m (t),0 

\ m=l 

Clearly, Rk, m (t) depends on the channel gains, transmit energies and the coding strategy used. We 
consider the space of coding strategies such that the rates achieved on sub-band m is independent of 
the rates on the other sub-bands. Alternatively, communications on various sub-bands are independent. 
Note that the communication on the same sub-band for various users may not be independent. 

Definition 1 (Scheduling Strategy): A scheduling policy A arbitrates the rate allocation Rk, m (t) 
and coding strategy for every user k and sub-band m in every slot t. 

This class includes offline policies that decide their rate allocation and coding based on the 
knowledge of arrivals and channel states in each past, present and even future slots. 

We assume that Q(t) and (4(i) for every k is known and a scheduling policy can utilize this 
knowledge in its decision process. In case of a possible ambiguity, we use superscript A to indicate 
the dependence of various terms on A, e.g., R^ m (t) and Efc m (t) will denote the rate and transmit 
energy respectively for user k in sub-band m in slot t under A. 

Definition 2 (Stability): The multi-access system is said to be stable if the mean queue length 
in every slot t for every user k is upper bounded by a number that is independent on t, i.e., 
sup t>1 {E[Qfc(t)]} < oo for every k. A scheduling policy that stabilizes the system is called stable 
scheduling policy. 

Note that every stable scheduling policy guarantees the required throughput a k to every user k, 
and in addition, guarantees bounded delay for the arrivals. 

Definition 3 (Power Efficiency): The power efficiency of scheduling policy A is defined as 
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Definition 4 (Optimality): A stable policy A is said to be optimal if with probability (w.p.) 1 it 
attains the smallest power efficiency among all the stable policies. 

Let Pmin(C) be the infimum of the power efficiencies of all the stable policies in a class C of 
scheduling policies. If C does not contain any stable policy, then P m - m (C) is defined to be oo. 
Furthermore, let P m \ D denote the optimal power efficiency, i.e., P m \ D = P m i n (C) where C is the 
set of all policies. 
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Definition 5 ( e-optimality ): A scheduling policy A is said to be e-optimal in class C of scheduling 
policies if it is stable and P A < P m i n (C) + e w.p. 1. Moreover, A is said to be e-optimal if it is 
stable and P A < P m \ n + e w.p. 1 . 



We present the following known results for the sake of completeness. To be consistent, we state 
these results in the notation introduced here. 

Fix a sequence of coding strategies in every slot and let C denote the class of scheduling policies 
that use this fixed sequence of the coding strategies. Also, let Ai(V) G C denote a parametrized 
scheduling policy that assigns the rates by solving the optimization problem 



Subject to: Rk, m (t) > for every k and m, 

where V is a fixed constant. Then, the following are the performance guarantees for Ai(V). 

Theorem 1 (Result from [7], [8], [9]): For every e > 0, there exists V > such that for every 
V > V, Ax(V) is e-optimal in C. 

We present the intuition for the result. Consider a case when Qt(t) is much smaller than V. 
Broadly, it implies that the user was receiving the desired rate in the past. Thus, Ai(V) provides 
positive rate to the user only if the corresponding energy cost is much smaller, i.e., when the user's 
channel gain is large. On the contrary, if Qk(t) is much larger than V, then it implies that the user 
was not receiving the desired rate and also that the user's average channel gain is small. Thus, Ai(V) 
provides positive rate to the user even when the user has, potentially, small channel gain in order to 
preserve stability. Alternatively, the current queue length represents the history of the rate provided 
to the user and its channel quality. Thus, Ai(V) estimates users' desired throughput and channel 
quality using the current queue length, and then invests just enough power to maintain stability. 

Given coding strategies, Theorem Q] provides a way to obtain e-optimal policies. Thus, it remains to 
determine how optimal coding strategy can be obtained in every slot. The following theorem provides 
useful guidelines in this direction. 

Theorem 2 (Results in [2]): For a given rate assignment . . . , Rn and channel states di, . . . , djv 
the total sum energy 2~2k=l ^k required to realize the rates is minimized by super-position coding and 
successive decoding. Moreover, for optimal signaling, the successive decoding order depends only on 
channel gains, but not on the rate assignment. 

Let 7? denote the permutation that sorts the gains in the increasing order, i.e., d ni < d n2 < • • • < 
d WN . Then, the required transmit energy per symbol for user tt^ is given by 



III. Background 



Minimize: Yl 



M 

m=l 



Y^k=l VEk,m(t) - 2~2k=l Qk(t)Rk,m(t) 




k — 



1] e £*<*^. 



(1) 
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IV. 6-optimal Scheduling Policy 



Let us define the following function for a fixed constant V. 



N 

EVD ^ def V^ VN ° 




'™ m(t) -E^(*)^-m(*) 



*!=i 



IV 



where 7r m is a permutation that sorts the gains on sub-band m in the increasing order. Now, let us 
consider a parametrized scheduling policy A*(V) that assigns in every slot the rates Rk, m (t) that 
solve 

Optimization (Ol) - Minimize: Em=i H^m^)) 

Subject to: Rk, m (t) > for every k and m, 
and then achieves the rates using super-position coding and successive decoding on each sub-band 
separately. Clearly, R^J^\t) = for every m, if Qk(t) = 0. We show the following optimality 
result for A*(V). 

Theorem 3: For every e > 0, there exists V > such that for every V > V, A*(V) is e-optimal. 
Proof: Let C* denote the class of scheduling policies that use super-position coding and successive 
decoding in every slot. Then, we show that P mm = P m \ n (C*). 

Let Ai denote any stable policy. Now, we construct A2 £ C* as follows. For every k, m and 
t choose R^ 2 m {t) = Rkmit)- Clearly, A2 is also stable. Moreover, by Theorem [2j for every t 

E™=iEti<™W < E^=i E£=i Thus > b y Definitional P Al > P^'- Since, A, is an 

arbitrary stable scheduling policy, we conclude that P m i n = P m i n (C*). 

Now, the result follows from Theorem Q] and (Q]). ■ 
Note that Theorem [3] provides a way to minimize power while stabilizing the system. The mini- 
mization is over the space of all coding and rate assignment strategies. The policy A*(V) achieves the 
optimality by taking into account only the current system state, and does not require the knowledge 
of statistics of the arrival and channel processes a priori. Moreover, optimality holds among the class 
of off-line scheduling policies. In spite of these desirable properties, A*(V) has one major limitation 
which is that it needs to solve a non-linear optimization (Ol) in every slot to obtain the optimal rate 
assignment. Solving (Ol) may be computationally expensive, and thereby limit the practicality of 
A*(V). In the following discussion, we focus on (Ol) and derive certain properties of the optimal 
solution and using these propose an algorithm that obtains optimal rate allocation with polynomial 
complexity. 

Since the communication on each of the sub-bands is independent, to solve (Ol), it suffices to 
solve separately for every m 

Optimization (02) - Minimize: F{R m {t)) 
Subject to: Rk, m (t) > for every k. 
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Moreover, since the nature of optimization (objective function and constraints) is identical for every 
m, an algorithm to solve (02) for a given m can be utilized for all m's. So, we fix m and t and 
focus on (02). 

In the following discussion, for notational brevity, we omit m and t. Also, without loss of generality, 
let ttV 1 = k. With this simplified notation (02) becomes 



Minimize: F(R) = £f =1 ^ [e*» - l] e^<* R * - YlLi QkRk 
Subject to: Rk > for every k. 

Note that (02) is strictly convex (see Appendix HJ). This can be verified by checking that the Hessian 
is positive definite in the positive half plane [13]. For convex optimization, polynomial complexity 
algorithms using the interior point method have been proposed [14]. These algorithms obtain a solution 
within 5 > neighborhood of the optimal value. The computational complexity of these algorithms is 
0(N S ) per accuracy digit [14]. We, however, propose the 0(N 2 ) complexity algorithm that computes 
the exact optimal solution. 

We start by looking at the Lagrange relaxation of (02). 
Minimize: F(R, A) = £f =1 Vg* [e Rk ~ l] R * - Ek=i(Qk + *k)Rk, 
where A = {Ai, . . . , Atv} are Lagrange multipliers. Now, for every k 



dF(R,X) 
dR k 



N 



VN 



=k+l 



(2) 



Lemma 1: The following relations satisfy 9F g R ^ = for every k. 
log 



Ri 



Ra 



log 



[(Qk + Afe 


)- 


-(Qk, 


-l + Afe+i)] 


_j i_ 

Ofe_ 1 rffc 


[(Qk-1 + Afc 


-i)- 


(Q* + A*)] 


_L ]_" 


(Qi + Ai) 




(Q 2 + A 2 )\ 






" i 


1 

d 2 







for k > 1 



(3) 



(4) 



by defining djv+i = oo and Qjv+i = Aat+i = 0. 

Proof: We show the required by proving that for every k, 9F qr^ = implies 

(Qk + Afe) — (Qk+i + Afe+i) 



.Ru 



VN 



l 



(5) 



We prove the above using induction on k. 

As a base case we show ([5]) for k = N. Note that substituting k = N in © and equating it to 0, 
we obtain ©. Thus, §5$ holds for k = N. Now, for induction, we assume that © holds for every 
A; > s + 1 and verify it for k = s. 
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Consider the second term in Q with k = s. 

N 

E ^(e*-i)«es* 



i=s+l 



^ VN o c ri-,R,> ^ VN ° c yr -' R - 



, di di 

l=S + l l = S + l 



N-l 



1 



i=s+l 

{Qs+i + A s+ i) 



di d. 



i+1 



3 eu*. + Z^° e E^ =1 -R, _ ^ e E;; =1 R u 



Last equality follows from © and the induction hypothesis. Now, substituting the above in ©, we 
obtain the desired. 

Finally, ® follows by observing R k = log ( el ~\ u k z\ Ru ) and (@]) is obtained directly from © with 

k = l. m 

Definition 6 (From [15], pp. 328): The vectors R' and A' are said to satisfy Karush-Kuhn-Tucker 
(KKT) conditions if they satisfy the following relations. 

dF(R, A) 



dR k 



= for every k (6) 

R=R' 

R! > (7) 



A' > (8) 

R' k \' k = for every k. (9) 
Since (02) is strictly convex in the feasible region, we conclude the following [15]. 

1) The optimal solution is unique. 

2) The rate allocation R' is optimal iff there exists A' such that R' and A' satisfy the KKT conditions. 
Also, such A' is unique since linear independence constraint qualification holds. 

In Figure [Q we propose a general procedure for obtaining a rate allocation R and Lagrange 
multipliers A that satisfy the KKT conditions for any given Q and d. We first intuitively describe the 
proposed algorithm and subsequently prove that the algorithm optimally solves (02). 

The main procedure Computation_of_Optimal_Rates takes current queue length vector Q and the 
channel gains d as input and outputs the optimal rate allocation R. In this procedure, we define two 
sets A and £ that partition the set of all users. The set A (£, resp.) denotes the set of active (inactive, 
resp.) users. A user k is said to be active if R k > 0, i.e., it is served at positive rate; k is inactive 
otherwise. Initially, all the users are assumed to be active (Line Hvl ). Next, the algorithm iterates 
and in each iteration determines an inactive user using (ITOT ) and (fTTb (Line |TVT ). Once the inactive 
user is determined the sets A and £ are updated (Lines [IV] and HVl ). and subsequently the Lagrange 
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Computation_of_Optimal_Rates(Q,d) 
begin 

1: Initialize A*-{1,..., N}, £ <- <f> and A <- 
2: while There exists A; g A such that 



(g h _i + A h _0[£- 




+ (Q fc+1 +A fc+1 )[^-i] 






dfc+1. 





1 1 



+ (Q 2 + A 2 ) 



do 



.4^ .4- {fc} 

Update_Lagrange_Multipliers(.4, £) 
{/* Optimal Rate computation */} 
6: Rk <— for every k £ £ 

7: Compute fi^ for every k a A using {3) and (4) 



for fc > 1 



(10) 



(11) 



end 



Update_Lagrange_Multipliers(„4, £) 
begin 

1: Afe «— for every k £ £ 

2: if {1, . . . ,u - 1} C £ and u e A then 

3: for every m £ {1, . . . ,u — 1} 



A m «- VjV 



1 1 



(12) 



4: if {« + 1, . . . , u - 1} C .A and {«, «} C £ then 
5: for every m £ {u + 1, . . . , u — 1} 



An 





dm 


t] 


+ Qu 


L d„ dm J 




:* 


-±] 





(13) 



end 



Fig. 1. Figure shows the pseudo code of an algorithm that computes the optimal rate allocation in a given slot 



multipliers are also updated (Line ITVl) . If no user in A satisfy (fTOb and (fTTT) . then the algorithm 
terminates after computing the rate allocation using © and (@]) (Lines JV] and ITVl ). This ensures that 
© is satisfied for all k G £. Now, we explain why a user satisfying (fTOl ) or (fTTT) should be inactive. 
Note that (TTOb and (TTTT > are equivalent to it^. < in © and ©, respectively. Since the assigned rates 
can only be non-negative, we put such a user k in £ and update corresponding Afc so as to ensure 
Rk = 0. 

Now, we briefly explain how the procedure Update_Lagrange_Multipliers computes Lagrange mul- 
tipliers in each iteration. Note that for every active user k, Xk must be zero in order to satisfy the 
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KKT condition ©. Thus in the first step, the procedure assigns = for every k G A (Line |TVT ). 
Next, for every k G £ , it computes A^ so that i?^ in © or © equals zero (Lines JV] to ITVl ). This 
ensures that ©, © and © hold for every k G A We need to recompute all the Lagrange multipliers 
in every iteration because the value of A^ is a function of Afc_i and Xf.+i as can be seen from © 
and ©. 

Even though the algorithm is straightforward, mainly, two questions are unanswered. First, whether 
Afc is non-negative for every k G £. Second, since the A^'s for many users (not only the recently 
added user) in £ are updated, how is it ensured that an inactive user does not become active in the 
subsequent iterations. We formally address these questions and prove the optimality of the proposed 
algorithm. 

For analysis, we introduce the following additional notation. Let R* and A* denote the rate vector 
and Lagrange multipliers computed by the algorithm at termination. Also, let A* and £* denote the 
sets A and £ , respectively, when the algorithm terminates. Next, we distinguish between the value 
of A, A and £ computed by the algorithms in every iteration. Let A\ A 1 and £ l denote A, A and £ , 
respectively, computed by the algorithm in i th iteration. Because of the initialization in Line [TV] of 
procedure Computation_of_Optimal_Rates, A = 0, A = {1, . . . , N} and £° = 4>. Let the algorithm 
terminate in / iterations. Then, clearly, I < N and X 1 = A*, A 1 = A* and £ T = £*. Now, we show 
the following result. 

Lemma 2: If A* > 0, then R* and A* satisfy the KKT conditions. 

Proof: Note that for every k G A*, R* k is computed using © and ©. Thus by Lemma [T] 
clearly, © is satisfied for every k G A*. Now, we show that © also holds for every k G £*. Note 
that R* k = for every k G £*. Thus, it suffices to show that when the chosen A* is substituted in 
© and © yields R* k = for every k G £*. The required can be easily verified using elementary 
algebra. Thus © holds for every k. 

Now, we show that A* satisfy ©. Since, R* k = for every k G £*, © clearly holds for every 
k G £*. Now, we show © for every k £ A*. We show the required using contradiction. Let there 
be k G A* such that R* k < 0. But then from © and © it implies that 



Qh 



< 



(Qk-i + A^_ : ) 


j i_ 

dk dk+i 


+ (Qk+i + K+i) 


'_1 1_ 

dk-i d k 




'_1 1_ 

dk-i dk+i 





if k > 1 



Qk < VN 



1 



1 



+ (Q fc+1 + A£ +1 ) iffc = l. 



_dk d k+ \ 

Now, from (fTOl ) and (fTTb . we conclude that the algorithm will not terminate, but instead add k to £ 
and continue. Thus, no such index exists. So, A* and R* satisfy ©. 
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The vectors A* and R* satisfy ([8]) because of the supposition in the lemma. Moreover, the vectors 
satisfy © because B% = for every k G £*, while A£ = for every k E A*. ■ 
In the following theorem, we show that A* is non-negative. 

Theorem 4: For every i < I, A* < A i+1 . 

Note that since A = 0, Theorem [4] implies that A* > 0. We prove the above theorem by showing 
the required in each of the cases that may be arise in the execution of the algorithm. The proofs use 
elementary algebra. For better readability, proofs for all the cases are given in Appendix |II1 

Finally, we prove the optimality of the proposed algorithm. 

Theorem 5: The rate allocation R* is the unique optimal solution of (02). 

Proof: The result follows immediately from the strict convexity of (02), Lemma [2] and Theo- 
rem m ■ 

V. Conclusion 

We have considered a multi-access channel with iV-users. We have proposed a parametrized 
scheduling policy A*(V) which is e-optimal for every e > for appropriate choice of the parameter 
V even among the offline strategies in spite of considering only the current queue lengths and channel 
gains in its decision process. Moreover, the optimization is over the joint space of coding and rate 
allocation strategies. The policy A*(V) needs to solve a convex optimization in every slot to obtain the 
optimal rate allocation. We have proposed a 0(N 2 ) algorithm that accurately solves the optimization. 
All the results extend in straightforward fashion to broadcast case because of uplink-downlink duality. 
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Appendix I 
Convexity of Optimization (02) 

The second partial derivative of F(R) is as follows. 

d*F(R) = f £f =fc+1 ^ (e* - 1) e£U *■ + *f * : j < k 
8R k dRj \ Y^l^U + Y,t j+ i ^ " 1) e ErJl ■ 3 > *■ 

Note that for every R € [0, oo) , dRk Q^. > for any k and j. This shows that the Hessian of 
F(R) is positive definite. Also, it is clear that the feasible region [0, oo)^ is a convex set. Thus, (02) 
is an instance of convex optimization. 



Appendix II 
Supporting Lemmas for Proving Theorem |4] 

Lemma 3: Let index k be added to the set £ i ~ 1 in the i th iteration. Then for all users u such that 
there exists v G A 1 between k and u, \ % u = \ % ~ . 

Proof: The proof follows immediately from the procedure Update_Lagrange_Multipliers in Fig- 
ure [Q ■ 
Lemma 4: Let index k be added to the set £ in the i th iteration. Also, let {k— 1, k+ 1} € A 1 ^ 1 . 
Then, — X 1 ^ 1 > for every n. 

Proof: Since index k is added to £ 1-1 in the i th iteration, we know the following. First, A^T 1 = 0. 
Second, from (TTOb 



(Qk-l + ^k-i) 


J 1_ 

d k d k+1 


+ (Q k+ i + x l k - + \)) 


r _L 1_ 

dk-i d k 




_J 1_ 

dk-i dk+i 





Qk < 



Note that A^_\ = A^ +1 = 0. Thus the result follows from £E3]>, (O) and Lemma [3] 



(14) 



DRAFT 



Lemma 5: Let index 1 be added to the set £ 1-1 in the i th iteration. Also, let {2, . . . , to — 1} C £ l ~ l 
and m Then, A^ — X 1 ^ 1 > for every n. 

Proof: Since index 1 is added to S 1 ^ 1 in the i th iteration, we know the following. First, A^ -1 = 0. 
Second, from (fTTT) 

Qi<VN i-i 

Moreover, since {2, . . . , m— 1} C and m ^ £ l ~ , we also know that for every n € {2, 
1}, 



+ (Qa + at 1 ; 



(15) 



, m— 



A 



i-1 





i i 

d n d m 


~i~ Qm 


J 1_ 




' 1 

di 


1 





Qn- 



(16) 



Now, substituting A2 from (fT6l ) in (031 ). we obtain 



Qi < 

Ql < VN 



1 1 

di d 2 



+ 



Qi 


1 i_ 

d 2 dm 


~\~ Qm 


' I 1_ 

di d 2 




' 1 
d 1 


1 

d m 





~i~ Qm- 



1 1 

d\ d m 

Now, note that from ([12]) . for every n = 1, . . . , m — 1 

1 1 



(17) 



XI = VNi 



~i~ {.Qm Qn)- 



dn d m 

From (fTTT ). clearly, X\ > 0. Now, from (fT6l ) and (fT8l ). it follows that for every n = 2, . . . , m — 1 



(18) 



i-1 



1 1 

dn. dim 



~t~ (Qm Qn) 



Qi 


' 1 1 

d n dm 


Qm 


"^L 1_" 

di d n 




1 

di 


1 

dm 





+ Qr. 



J 1_ 

d„ dm 



\\ > 0. 



_1 1_ 

d\ dm 

The last inequality follows from the fact that dk < dk+i for every k and X\ > 0. Furthermore, by 
Lemma [3j for n ^ {1, . . . , m — 1}, X 1 ' 1 = X l n . Thus, the result follows. ■ 
Lemma 6: Let index k > 1 be added to the set £ l ~ l in the i th iteration. Also, let {v +1, . . . , k— 1} C 
S 1 - 1 and {«, fc + 1} C A\ Then, - A^" 1 > for every n. 

Proof: Since index k is added to in the i th iteration, we know the following. First, A^, -1 = 0. 
Second, from (TTOb 

Qk < 



(Qk-i + X l k _\) 


j i_ 

d k d k+1 


+ (Q fe+1 + A*-\)) 


_J 1_ 




"_L 1_ 

dk-i dk+i 





(19) 
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Moreover, since {v + 1, . . . , k — 1} C £ l 1 and {v, k, k + 1} C A 1 1 , we also know that for every 
n € {v + 1, . . . , k - 1}, 



A 



Qv 


j i_ 

d„ d k 


+ Qfe 


1 1 

d„ d n 




' 1 


1 

d k 





Qr 



(20) 



Now, substituting A 4 fc+1 = and A^J^ from ([20]) in ([HI), we obtain 



Qk < 



Qk < 



Q v 


1 I_ 

d fc-l d k 


+Q k 


_i i_ 




J 1_ 

d k d k +\ 


+ (Q fc+ i + A|- 1 1 )) 


_J 1_ 

d k - i 


_i i_ 

_d v d k 






_J 1_ 

d k —i dfe+i 





Qv 


"j. i_ 


+ Qfc+ 


i 


"j. i_ 




i 


i_ 





(21) 



Now, note that from (fT3l) . for every n = u + 1, . . . , k 



a: 



Qv 


j i_ 


+ Q/c+ 


1 


1 1 

<f„ d n 




1 


i_ 

d k +i 





Qn ■ 



(22) 



From ([2Tb and (l22l) . clearly, A|, > 0. Now, from (l20l and (l22l . it follows that for every n = v 
l,...,k-l 



A n ~ A n 



i-l 



Qv 


' i i_ 

d n d k +i 


+ Qk+1 


" 1 1 " 

d v d n 


Qv 


j. i_ 

d n d k 


+ Qk 


' i i " 

d v d n 




' I 1_ 

dv d k+1 




1 1_ 

dv d k 





J 1_ 

d v d„ 



Al > 0. 



i i_ 

d v d k 

The last inequality follows from the fact that d n < d n+ \ for every n and A^, > 0. Furthermore, by 
Lemma [3j for n £ {v + 1, . . . , k}, X 1 ^ 1 = X n . Thus, the result follows. ■ 
Lemma 7: Let index k > 1 be added to the set £ % ~ 1 in the i th iteration. Also, let {1, . . . , k— 1} C 
£ 1 - 1 and fc + 1 G ^. Then, A^ - A^ 1 > for every n. 

Proof: Since index k is added to £ 1-1 in the i th iteration, we know the following. First, A^, -1 = 0. 
Second, from (fT0l 



(Qfe-i + AJ._\) 


j i_ 

d k d k+1 




i i_ 

dh-i d k 




' _J 1_ 

d k -i dfc+i 





(23) 



Moreover, since {1, . . . , k— 1} C £ % 1 and k € A % , we also know that for every n € {1, . . . , k 



1}, 



1 1 



+ {Qk - Qn) 



(24) 
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Now, substituting = and X l k \ from ([24]) in ((23]>, we obtain 



Qk < 



(VN 


' _j i_ 

dk-i d k 


+ Q k ) 


' 1 1_ 

dk dk+i 


+ Qk+1 


' _1 1_~ 

L 4-i <4 




i 

dk- 


1_ 

i dk+i 





Q fc < ^iV 



l 



_dk dk+i 

Now, note that from (fT3l) . for every n = 1, . . . , k 

K-vn, 1 1 



+ Qk+1- 



d n dk+i 



+ (Qk+1 — Qn)- 



(25) 
(26) 

(27) 



From (|26]> and (|27]>, clearly, Aj^ > 0. Now, from (O and d27]), it follows that for every n = l,...,k—l 



1 1 



<4 dk 



+i 



+ (<2fc+i — Qk) 



XI > o. 



Furthermore, by Lemma [3) for n {1, ... , fc}, X L ~ l = X L n . Thus, the result follows. ■ 
Lemma 8: Let index k > 1 be added to the set in the i th iteration. Also, let {fc+1, . . . , u— 1} C 
£"* _1 and {/c — 1, u} C .4*. Then, A^ — X 1 ^ 1 > for every n. 

Proof: Since index k is added to £ 4-1 in the i th iteration, we know the following. First, AJT 1 = 0. 
Second, from (TTOb 

(Qfc-l + A l fe l\) - g^- + {Qk+i + Afc+i)) 3^7 " i 
Q fc < 1 J i. (28) 



(Qfe— i + Afe-\) 


"j 

d k a 


1 

fc+i 


+ (Q k +i + X l k+ \)) 


'_1 1_ 




1 

dk- 


i_ 

i dk+i 





Moreover, since {A; + 1, . . . , u — 1} C £ 1 1 and {k — 1, fc, u} C ,A l 1 , we also know that for every 
n G {k + 1,... - 1}, 



A 



i-l 





i i 




j i_ 

dk d n 




"_1 


i " 

d u 





Qn- 



(29) 



Now, substituting X\2i = and X 1 ^ from ([29]) in ((28]>, we obtain 



Qk- 



Qk < 



Qk < 



i i_ 

dk dk+i 



+ 



1 1_ 



_i i_ 



_i i 



__L 1_ 



_J ]_ 

CJfc_l ^fc + l 



Qk-l 


1 

d k 


1 

du 


+ Q U 


_J 1_ 

dk-i d k 




1 

d k - 


i " 

i d u _ 





(30) 



Now, note that from (fT3l) . for every n = k, . . . ,u — 1 

A! 



Qk-l 


' 1 

d n 


1 " 

d„ 


+ Q« 


'_1 1_ 

dfe—i d n 




1 


i 

i d„_ 





Qn- 



(31) 
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From (l30l ) and (|3"TT) . clearly, X l k > 0. Now, from (|29l ) and (f3TT >. it follows that for every n = k + 



! Qfc-1 


1 1 

dn d n 




" j i_ 

dk-i d„ 


Qk 


' 1 1 " 

dn d„ 




' I 1_" 

d k d„ 




_J 1_ 




J 1_ 

dfc d u 





1 


1 


d„ 


d u 


J_ 


1 




d„ 



Al > 0. 



The last inequality follows from the fact that d n < d n+ \ for every n and Al > 0. Furthermore, by 
Lemma [3j for n {k, . . . , u — 1}, A^ -1 = A^. Thus, the result follows. ■ 
Lemma 9: Let index k > 1 be added to the set £ l ~ l in the i th iteration. Also, let {v + 1, . . . ,k — 
1} U {k + 1, . . . , u - 1} C f* -1 and {«, u} C „4\ Then, A^ - X^ 1 > for every n. 

Proof: Since index k is added to £* -1 in the i th iteration, we know the following. First, Al -1 = 0. 
Second, from (ITOb 

(Qfc-i + A l fc l\) - + + A^\)) [gi- - ij 
Vfc < — ~ • (-> 2 ) 





j i_ 


+ (Q fc+ i + A^- 1 1 )) 


_J 1_ 

dk-i d k 




"_L 1_ 





Moreover, since {v + 1, . . . , k - 1} U {A; + 1, . . . , u - 1} C S ' 1 ' 1 and {v, k, u} C .A*" 1 , we also 
know that for every n G {i? + 1, . . . , k — 1}, 



and for every n € {/c + 1, . . . , u — 1}, 

A- 1 



Qv 


j i_ 

dn d k 


+ Qk 


' 1 1 " 

d„ d„ 




1 

d, 


1_ 

d k 





(33) 





i i 


+ Q U 


" J 1_ 

dfc d„ 




J_ 

dk 


i " 

d„ 





Qn,' 



Now, substituting A^,_ 1 and Ajj. , j from (l33l and (l34l ). respectively, in (l32l ). we obtain 



(34) 



=> Qk < 

Now, note that from ([T31) . for every n = t> + l,...,w — 1 

A! 



0. 


1 1 
d k-l d k 


+Qk 


1 1 

d v d k _ 1 




_L ]_" 

a*. dfc_i_i 




1 1 
d fc+l d " 




i i 
d k d k+i 




"_L 1_" 

d k -i d k 




1 1 

. d n d k. 






1 1 






_L ]_" 

dfc_i <ife+i 





Qv 


1 1_ 

d k d u 


+ <2« 


J 1_ 

d„ d k 




' 1 

d, 


1 " 

d u 





(35) 



Qv 


i i 

d„ d„ 


+ Q U 


1 1 

d„ d„ 




" 1 

d, 


1 

d u 





Qn- 



(36) 
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From (I35T ) and (l36l) . clearly, A| > 0. Now, from (l33T > and (l36l ). it follows that for every n = v + 
l,...,fc-l 



Qv 


i i 


+ Qu 


1 1 

dv d n 


Qv 


_i i_ 




i i 

d„ d„ 




i i 




1 1_ 

d„ dfe 





J 1_ 



1 1_ 

d„ d k 



XI > 0. 



The last inequality follows from the fact that d n < d n+ \ for every n and X\ > 0. Moreover, from 
(1341) and d36l) . it follows that for every n = /c + 1 





i i 

dn d u 


+ Qu 


1 1 

d v d n 


Qk 


1 1 

d n d u 


+ Qu 


i i_ 

d k d n 




1 1 

d„ du 




1 1_ 

dk d u 





J 1_ 

d„ d u 



Al > 0. 



j i_ 

d k d u 

Furthermore, by Lemma [3l for n {v + 1, . . . , u — 1}, AJ, -1 = X n . Thus, the result follows. ■ 
Lemma 10: Let index k > 1 be added to the set f*" 1 in the i th iteration. Also, let {1, . . . , k — 

1} U {& + 1, . . . , u - 1} C S 1 - 1 and u € >. Then, A^ - Aj^ 1 > for every n. 

Proof: Since index k is added to in the i th iteration, we know the following. First, A^. -1 = 0. 

Second, from (TTOb 

Qk < 



(Qk-i + ^fc_\) 


'_i i_ 

^d fc d fc+ i 


+ (Qk+i + K+\)) 


"_L 1_~ 

dfc-i dfc 




_L 1_ 

dk-i dk+i 





(37) 



Moreover, since {1, . . . , k - 1} U {A; + 1, . . . , u - 1} C and {k, u} C .4*" 1 , we also know 
that for every ne{l,...,fc-l}, 

"1 I' 



X 1 - 1 = VN 



+ (Qk ~ Qr 



(38) 



and for every n 6 {k + 1, . . . , u — 1}, 



vi-l 





i i 

d„ d„ 


+ Qu 


1 1_ 

d k d n 




1 

d* 


1 

d u 





Qn- 



(39) 



Now, substituting X\,2\ an d from (I38T ) and (l39l . respectively, in (l37l ). we obtain 



_j i_ 

dfc-i dfc 



J 1_ 

d k d k+1 



+ 



1 1_ 



_1 3_ 



_1 1_ 



_J 1_ 

dh-i d k 



_j l_ 



i i 

<4 d« 



(40) 
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Now, note that from (1131) . for every n = 1, . . . , u — 1 

1 1 " 



XI = VNr, 



d n d u 



+ {Qu - Qn)- 



(41) 



From (00]) and (@J]), clearly, A^. > 0. Now, from ([38]) and ((4T|), it follows that for every n = l,...,k—l 



A n — A n 



i-l 



1 1 



+ (Qu - Qn) ~ VN 



1 1 



[Qk — Qn) 



VNq 

= A|>0. 

The last inequality follows from the fact that and At > 0. Moreover, from d39l ) and (|4T1) . it follows 



that for every n = k + 1, . . . ,u — 1 

VN 



A n ~ A n 



i-l 



1 1 

dn d u 



+ Qu 



Qk 


1 1 


+ Q U 


1 1_ 

dk d n 




' 1 

_d,, 


i 





Al > 0. 



"1 1 " 

_ d n d u 

Furthermore, by Lemma [3l for n £ {1, . . . , u — 1}, A„ = A^. Thus, the result follows. 
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